Solving Hidden Non-markovian Models: How to Compute Conditional State Change Probabilities

نویسندگان

  • Claudia Krull
  • Graham Horton
چکیده

Current production systems produce a wealth of information in the form of protocols, which is hardly exploited, often due to a lack of appropriate analysis methods. Hidden non-Markovian Models attempt to relieve this problem. They enable the analysis of not observable systems only based on recorded output. The paper implements and tests solution algorithms based on the original Hidden Markov Model algorithms. The problem of computing the conditional state change probabilities at specific points in time is solved. The implemented algorithms compute the probability of a given output sequence and the most probable generating path for Markov regenerative models. This enables the analysis of protocols of not observable systems and the solution of problems that cannot be solved using existing methods. This opens up new application areas, including a different approach to mining the wealth of data already collected today with huge monetary effort.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Markovian Models for Sequential Data

Hidden Markov Models HMMs are statistical models of sequential data that have been used successfully in many machine learning applications especially for speech recognition Further more in the last few years many new and promising probabilistic models related to HMMs have been proposed We rst summarize the basics of HMMs and then review several recent related learning algorithms and extensions ...

متن کامل

Quantifying and localizing state uncertainty in hidden Markov models using conditional entropy profiles

A family of graphical hidden Markov models that generalizes hidden Markov chain (HMC) and tree (HMT) models is introduced. It is shown that global uncertainty on the state process can be decomposed as a sum of conditional entropies that are interpreted as local contributions to global uncertainty. An efficient algorithm is derived to compute conditional entropy profiles in the case of HMC and H...

متن کامل

Monte Carlo Simulation to Compare Markovian and Neural Network Models for Reliability Assessment in Multiple AGV Manufacturing System

We compare two approaches for a Markovian model in flexible manufacturing systems (FMSs) using Monte Carlo simulation. The model which is a development of Fazlollahtabar and Saidi-Mehrabad (2013), considers two features of automated flexible manufacturing systems equipped with automated guided vehicle (AGV) namely, the reliability of machines and the reliability of AGVs in a multiple AGV jobsho...

متن کامل

Consistency of the Maximum Likelihood Estimator for General Hidden Markov Models

Abstract. Consider a parametrized family of general hidden Markov models, where both the observed and unobserved components take values in a complete separable metric space. We prove that the maximum likelihood estimator (MLE) of the parameter is strongly consistent under a rather minimal set of assumptions. As special cases of our main result, we obtain consistency in a large class of nonlinea...

متن کامل

Computing Conditional Probabilities in Markovian Models Efficiently Extended Version

The fundamentals of probabilistic model checking for Markovian models and temporal properties have been studied extensively in the past 20 years. Research on methods for computing conditional probabilities for temporal properties under temporal conditions is, however, comparably rare. For computing conditional probabilities or expected values under ω-regular conditions in Markov chains, we intr...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2009